MICROCOPY  RESOLUTION  TEST  CHART 

national  Bureau  of  stanoabos-i*65- a 


AAo 


(:h"t»  n 


AD-A161  293 


- 2.  - 

M693 

D-76 

3-;  REcrPTFUT  cmcnjr'TOpn 

TITLE  (and  subtitle) 

On  The  Limit  Behavior  Of  A  Multi -Compartment 
Storage  Model  With  An  Underlying  Markov  Chain 

I:  Without  Normalization 

>j  aw  ’J  ft  PMfU'AH 

5.  PEkForT^T  1WTT  REPORT  TIMBER 

AUTHOR ( s ) 

Eric  S.  Tollar 

«.  CiHTKACT  OR  mm  HUMBER ( s ) 

USARO  No.  DAAG  29-82-K-0168 

PERFORMING  ORGANIZATION  NAME  A*,r)  ADDRESS 

The  Florida  State  University 

Department  of  Statistics 

Tallahassee,  FL  32306-3033 

10.  PROGRAM  ELEMENT,  PROJECT,  TASK 
AREA,  A  UQRK  UNIT  NUMBERS 

:  urjHwnxTfi?T  office  ww.  nno  * 

U.S.  Army  Research  Office  -  Duiham 

P.0.  Box  12211 

Research  Triangle  Park,  NC  27709 

Vi.  REPORT  DATE 

February  1985 

U.  i'UoBER  OF  PAteS 

17 

.  IRTTUrT^T  AAEUCY  i-W-iF  *  ADDRESS" (if 
different  from  Controlling  Office) 

- ATcTlTIt  mlT  f  iTi  1  ^TATC,:i?hT  J  ui,  - 

lb.  SECURITY  CLASS,  (of  this  report) 

lba.  UECLASSIFICATIOO/OU'lrHiRAhtnC, 

SCHEDULE 

... 

approved  for  public  release;  distribution  unlimited 

orrrRTWTThT  STATE'iEdT  (of  the  abstract  entered  in  k  1  ock  2i>,  if  different  from  report) 


.  SUPPLEMENTARY  NOTES 


.  KEY  * 


Storage  model,  Markov  chain;  Dual  Markov  chain,'  Auxiliary  Markov  chain 


ABSTRACT  (Continue  on  reverse  side  if  necessary  and  identify  by  block  number) 


The  present  paper  considers  a  multi-compartment  storage  model  with  one  way 
flow.  The  inputs  and  outputs  for  each  compartment  are  controlled  by  a  denumerable 
state  Markov  chain.  Assuming  finite  first  moments,  it  is  shown  that  certain 
compartments  converge  in  distribution  while  others  diverge,  based  on  appropriate 
first  moment  conditions  on  the  inputs  and  outputs. 

*• '  >  '—-V 


m 


11  1.9  OS4 


otic  riuE  coey 


/y&O  /9 3 (>7.  30-/*)/). 


ON  THE  LIMIT  BEHAVIOR  OF  A  MULTI -COMPARTMENT  STORAGE  MODEL 
WITH  AN  UNDERLYING  MARKOV  CHAIN  I :  WITHOUT  NORMALIZATION 

by 


Eric  S.  Tollar 


FSU  Statistics  Report  M693 
USARO  Technical  Report  No.  D-76 


February,  1985 


The  Florida  State  University 
Department  of  Statistics 
Tallahassee,  Florida  32306 


Research  supported  by  the  U.S.  Army  Research  Office  under  Grant  DAAG  29-82-K-0168 
Keywords:  STORAGE  MODEL,  MARKOV  CHAIN,  DUAL  MARKOV  CHAIN,  AUX ILLARY  MARKOV  CHAIN. 


AMS  (1980)  Subject  classifications.  Primary  60G99 


On  the  Limit  Behavior  of  a  Multi -Compartment  Storage  Model 
with  an  Underlying  Markov  Chain  I:  Without  Normalization 


Eric  S.  Tollar 


ABSTRACT 


The  present  paper  considers  a  multi- compartment  storage  model  with  one  way 
flow.  The  inputs  and  outputs  for  each  compartment  are  controlled  by  a  denumerable 
state  Markov  chain.  Assuming  finite  first  moments,  it  is  shown  that  certain 
compartments  converge  in  distribution  while  others  diverge,  based  on  appropriate 
first  moment  conditions  on  the  inputs  and  outputs. 
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1 .  INTRODUCTION 


Using  a  stochastic  model  to  approximate  the  behavior  of  various  physical 
storage  systems  has  become  wide  spread  (for  example,  see  Moran  [6],  Prabhu  [7]). 
Initially,  the  random  mechanism  underlying  the  models  was  assumed  to  be  inde¬ 
pendent,  but  in  1965  Lloyd  and  Odoom  [5]  proposed  a  model  in  which  a  dependent 
structure  was  feasible  by  assuming  an  underlying  Markov  chain  as  part  of  the 
random  mechanism.  The  stochastic  model  was  later  expanded  to  having  an  under¬ 
lying  semi-Markov  process,  and  a  specific  one  compartment  storage  model  with 
underlying  semi-Markov  process  was  considered  by  Puri  [8] ,  Puri  and  Senturia  [9] , 
[10],  Balagopal  [1],  Puri  and  Woolford  [11],  and  others. 

In  this  paper,  we  will  consider  a  multi-compartment  storage  system  with  one¬ 
way  flow,  similar  to  that  of  Puri  and  Senturia.  However,  we  will  only  consider 
the  model  with  an  underlying  Markov  chain;  the  more  general  case  for  semi-Markov 
processes  to  be  considered  in  a  later  paper.  In  this  model,  material  will  flow 
into  the  system  via  compartment  1.  Each  of  the  subsequent  compartments  will  get 
material  from  its  immediate  predecessor  by  "demanding"  a  certain  amount  of  mate¬ 
rial.  The  previous  compartment  will  then  transfer  the  material  demanded,  or  all 
the  material  in  the  compartment,  depending  on  which  is  smaller.  Finally,  the 
system  will  lose  material  by  "demands"  placed  on  the  laSts-Compartment,  .rwhiLehsare 
dealt  with  as  above;'*  */'••  :  -'bov.;; . 

In  section  2  we  will  give  the  mathematical  formulation  of  the  model,  and  the 
closed  form  for  the  amount  in  each  compartment.  In  section  3  we  will  establish 
the  limit  behavior  of  the  compartments  without  normalization. 


2.  THE  r:ODEL 


Let  {Xn>  n=0,  1,  . . . }  be  an  aperiodic,  irreducible,  positive  recurrent 
Markov  chain  with  state  space  J,  where  we  take  J  to  be  denumerable.  We  denote 
the  elements  of  J  by  {1,  2,  ...}.  Define  the  transition  matrix  for  the  Markov 
chain  P  =  (p^)  by 

and  let  £=(it^,  tt^,  ...)  be  the  stationary  probability  measure  satisfying  itP  =  n. 
Further,  we  define  the  number  of  visits  to  stage  j  e  J  in  n  steps  by 

M.(n)=X  I(X.  =  j)  (2.2) 

J  i  =  0 

where  1(A)  is  the  indicator  function  of  set  A. 

For  the  k-compartment  model  to  be  considered,  the  transmission  of  material 
in  the  system  will  be  controlled  by  the  underlying  Markov  chain  (Xn)  and  a  col¬ 
lection  of  infinite  k  ♦  1  -  tuples  governing  the  transfer  of  material.  These 
k  +  1  -  tuples  are  defined  as  follows.  For  each  i e J,  let 

(V  (i)  =  (V  _(i) ,  V.  (i) ,  . . . ,  V.  (i)) :  n  *  1,  2,  be  a  sequence  of  i.i.d. 

o,n  1)11  k,ti 

k  +  l- tuples,  independent  of  (X^)  and  (V^i))  for  j*i.  We  will  insist  that  the 
following  conditions  hold. 


i) 


P(  u  (V,  (i)*0, 

j  *’n 
Os£,j  5k 


V.  _(i)*0})  -0,  Vi, 

J  9  11 


Vn  >  0. 


(2.3) 


ii)  P(V.  n(i)  <0)  =0Vi,  V j  ,  Vn>0. 

J  •  “ 

As  will  be  seen  later,  the  assumptions  (2.3)  are  not  mathematically  neces¬ 
sary.  However,  it  is  not  clear  that  the  model  itself  would  be  reasonable  without 
them.  Without  (2.3i),  we  would  have  the  problem  of  simultaneous  transfers  in 
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more  than  one  compartment,  and  it  is  not  clear  what  should  be  done  in  this  case. 
Without  (2.3ii)  we  would  not  have  a  one-way  flow  model,  and  it  would  be  there¬ 
fore  possible  to  have  compartments  with  negative  amounts  of  material  in  them. 

To  define  the  equations  for  the  total  amount  of  material  in  each  of  the  k 
compartments,  we  first  define  C(n)  «*  (CQ(n) ,  y  (n),  ...,  C^(n)),  where  C^n) 
represents  the  total  amount  of  material  that  has  left  compartment  i  by  step  n. 
Then  it  is  easy  to  see  that  the  amount  of  material  in  the  various  compartments, 
denoted  by  Z(n)  =  (Zj(n),  ...»  Z^fn)),  is  governed  by  the  relation 

zi(n)  =ci-i(n) -ci(n).  (2.4) 


We  define  C(n)  recursively  by 


tyn) 


C°(ll)  *  i-^0*1^  +C°' 

C? ,  for  n  *  0 

minted  _1(n),  (Xj)  +  yn  -  1)  ] ,  for  n>  0,v  .  * 


where  C*,  CJ,  . ..,  C£  are  the  initial  values  of  C(0)  (possibly  random), 
satisfying 


(2.5) 

(2.6) 


C*  SCJ  2:  ...  £C£  a.s. 


(2.7) 


By  examination  of  equations  (2.4)  through  (2.7),  it  is  easy  to  see  the 
system  will  function  as  explained  in  the  introduction. 

To  shorten  the  expressions  for  subsequent  theorems,  the  following  notation 


S*(n) 


0 ,  for  n  ■  0 

X  v£  iCy  *C{ 

i  *  1  1  1 


,  for  n  >  0 . 


is  introduced. 
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The  following  relationship  holds  for  isisk,  nil. 


Cj(n) » 


0  s  s  . . .  s  s  n 


{S0 (jp  ♦  IS102)  -  SjCjj)]  +  ...  ♦  [S.(n)  -  S.(j.))) 


The  proof  will  be  omitted,  as  it  is  straightforward  by  induction,  establishing 
the  validity  for  each  cell  i  by  assuming  it  is  true  for  the  previous  cells. 


COROLLARY :  The  following  relation  holds  for  1  Sisk,  n>0: 


Z^n)  = 


Os  ...  s  ^sn 


[SqCJj)  +  . . .  ♦  (S^jCn)  -  si  l(ji  j))] 


0  s  j  s  . . .  s  ^  s  n 


[SoCjj)  ♦  ...  ♦  (S.(n)-S.(j.))]. 


The  proof  is  omitted,  as  it  follows  immediately  from  the  theorem. 

In  the  next  section,  we  establish  the  limit  behavior  of  Z(n)  without 
normalization. 


a 


3.  LIMIT  BEHAVIOR  OF  THE  PROCESS 


In  this  section  we  establish  the  limit  behavior  of  the  process  Z(n)  without 
any  normalization,  when  a  first  moment  condition  is  assumed.  The  necessary  mo¬ 
ments  are  the  standard  ones  for  processes  defined  on  a  Markov  chain.  That  its,  .*  if 
x  is  the  stationary  measure  for  the  Markov  chain  and  if  for  every  j  e  J,  (Y^Cj) } 
is  an  i.i.d.  sequence  for  each  j,  independent  of  the  Markov  chain  and  (Yn(i)>  if 
i *  j ,  then  we  define 


V.I/flHl' 

J  €  J 


(3.1) 


For  ls£sk  we  will  refer  to  compartment  l  as  subcritical,  critical  or 


> 


supercritical  when  E  Vr  mm  (E  V.)  is  greater  than,  equal  to,  or  less  than 

" 1  Osi<£  "  1 

zero,  respectively.  It  will  be  established  that  as  n  tends  to  infinity,  the 
subcritical  compartments  converge,  while  the  critical  and  supercritical  compart¬ 
ments  diverge. 

The  following  definitions  will  also  be  used  in  this  section. 


Definition:  {X  }  is  called  the  dual  Markov  chain  of  {X_}  if 
-  r.  -  n 

1)  P(XQ  *  j)  =  ^  for  all  j,  and 


2>  p'iin.i*1IV»'";IVir 

As  has  been  shown  (see  Qinlar  [3]),  we  have  that  {Xn>  is  essentially  the  "reverse 
of  (Xn),  that  is,  if  XQ  has  distribution  £, 

P(Xmsi0'  •  Xm+n  *  V  *  P(Xm  "  V  *to+n  "  V  *  (3,25 

We  will  define 


Z.(n)  = 


0  s  S  . . .  S  ji  l S  n 


(Si.1(j1)^Si_2(j2)-S._2(j1)]  +  ...*[S0(n)-S0(ji_1)]) 


(3.3) 


0  s  s  . . .  s  s  n 


(SiOi)*[Si.i(32)-Si.1(ii)]  +  ...  +  [So(n)-§0Oi)]) 


where  for  given  n. 


S£(m)  = 


l  Vi  i(Xi)  for  m  <  n 
i  *  1  ’ 

m 

£  V£  j(^)  +  C£  for  m  =  n. 
Li  B  1  * 


(3.4) 


It  can  then  be  easily  shown  if  Xq~it  that 


P(^i  (n)  s  x  f ,  ...,  (n)  S  x^,)  ®P(21(n)  Sxi,  ...,  Z^  (n)  sx^)  .  (3.5) 


Definition:  {X  }  is  called  the  auxiliary  Markov  chain  of  (X  }  if  X  has  initial 


-  n  1  it  v 

distribution  it,  and  transition  probabilities  as  in  (2.1).  As  shown  in  Hoel, 
et  at.  [4] ,  if  we  define 


T  =  min  (X.  =  X . } , 
i  >0 


(3. 


then  T  <  <*>  a .  s .  and 


P(XM+1  =  V  **•'  XM+n=V  TSM)  *  Pf*M+l  =  V 


*M+n  ~ *n* 


TSM).  (3.7 


We  will  also  define 


S„(n) 


0,  for  n  =  0 
n 


I  V»  .(X.)  +  C*  for  n  >  0, 
i  =  l  t’1 


(3. 


and  define 


Z.(n)=  min  +  +  - ••  +  [Si-l(n)"Si-lCji-l)1) 

(3 

min  (S0(j1)*[S1(j2)-§1(j1)]+...+[S.(n)-§i(ji)]). 

0sj1s...sji^n 


The  main  theorem  to  be  established  in  this  section  is  the  following: 


THEOREM  3.1.  For  any  arbitrary  distribution  of  XQ  and  Z(0) ,  _i£  E^. | 1  <  <»  for 
OS  j  sk,  then  as  n -»•«>,  P(Z1(n)  s  x^,  . . . ,  Z^(n)  S  xk) -*•  P(Zj  s  x^,  . . . ,  Z^  S  x^) 

xv)  of  the  distribution  of  some  random 


for  all  continuity  points  (x 


I  •  •  •  I 
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P(Z.  <«)  *<{ 


0  if  E  V.  s  min  (E  V.) 
11  3  0£i<j  * 

1  if  E  V.  >  rain  (E  V.) 

*  3  D^i<3  11  1 


The  proof  of  this  theorem  requires  several  steps,  which  are  broken  down 

into  the  lemmas  and  theorems  that  follow.  The  first  such  lemma,  which  is  stated 

without  proof,  is  a  straightforward  extension  of  the  well  known  result  that 

lim  max  (  J  Y.  (X.))  ■  Z*  a.s. ,  where  P(Z*  <  «)  =  0  •  I(E  Y  £  0)  +  1  •  I (E  Y  <  0)  , 
n-*»  Osjsn  i  =  0  1  11  w 

for  {Yn(j)}  as  in  (3.1). 


LEMMA  3.2.  If  for  all  j  c  J,  (Y^j)  *  (Yj  ^(j) ,  ....  Y£>n(j)):  n£l)  is  an  i.i.d, 
sequence,  independent  of  (Y^Ci)}  for  i  *  j,  and  if  E^jY. |  <  ®  for 

l  jk 

lim  max  (  £  I  Yt  i(XJ))=Z*  exists  almost  surely, 

n-«  Os  jjS  ...  S  j£Sn  k  =  l  i  =  l  K>1  1 

where 


1  s  i  s  £,  then  lim 


P(Z*  <<*■)={ 


f  1  if  I  EvYi  <  0  for  all  i,  lsis£ 
0  otherwise. 


The  next  theorem  to  be  established  is  the  following. 


IKEiQftEMi  .3,. £ •  Let  XQ  have  initial  distribution  it ,  Eff | V ^ | for  0  s  j  s  k .  Then 
for  all  initial  distributions  Z(0) ,  as  n-+« 

P(Zj  (n)  s  Xj ,  . . . ,  Z^(n)  s  x^)  -*-P(ZjSxj,  ...,  Z^  s  xk) 

fpT  all  continuity  points  (xj,  ....  xk)  of  the  distribution  of  (Zj,  ...,  zk) , 
where  for  1 s l  s  k. 


P(Z„  <«)  =  0  •  I (E  V*  <  min  E  V.)  +1  •  I(E  V(>  min  E  V.) 
1  v  1  0si<£  1  *  1  Osi  <1  "  1 


PROOF .  From  (3.5),  we  have  that  we  need  only  consider  (Z^(n),  ...»  Z^(n))  to 
complete  the  proof.  The  almost  sure  behavior  of  each  Z^(n)  is  established  as 
n-*-®;  the  joint  behavior  then  follows  automatically.  From  (3.3)  we  can  see 
that  for  any  i. 


Z.(n)  =  max  (-S  ( j)  -  . . .  -  [SQ(n)  -  S0(j.) ]) 

OS  5  ...  s  jj.<n 


max  (‘Si-l(V  ‘  "tso(n)  "S0(ji-1^5 

OS  jjS  ...  s  j  sn 


0sjls...s;ji<n  k  =  l 


(I.llA'-iw'iill'V-ll 


0  s  j  s . . .  £ j  sn  k  *  1 


^  ,  ^i-k-l(V  "  ®i-k(V  J  ’ 


OsjjS  ...  sji<n  k  =  1 


^  ^i-k^k5  "  ^i-k+l^k^ 


OSjjS  ...  s  j^  ^<n  k  =  l 


By  defining 


(3.10)  reduces  to 


Z.(n)  =  max  [  l  Ri_k+1(3J] 

OS  jj  s  ...  s  jisn  k  =  l  1 

i  -  1 

max  [  l  Ri.k(jk)] 

0  s  j  j  s  . . .  s  i .  .  s  n  k  =  1 


(3.12; 


For  i  =  l,  we  have  for  all  initial  distributions  of  Z^(0),  as  n->-®. 


Z^n)  =  max  (RjCj))  •+•  ,  a.s. 

Os  j  in 

where 


P(Z.  <»)  =0  •  I (E  V.  <  S  V.)  +  1  •  I(E  V,  >  E  V  ) . 

^  1  IT  1  TlCr  irl  TT  0J 

(For  details,  see  Puri  and  Koolford  [11].)  Since  this  is  the  condition  desired 
for  i  =  l,  we  proceed  by  induction,  assuming  the  theorem  holds  for  £si  and 
showing  it  is  true  for  i  1 . 


'.<■  =  max  {£:  E  V,  =  min  (E  V.)} 
0<£<i  *  1  OSjSi  J 


(3,13 


Then  from  (3.12)  we  have 


zi>i(n)  = 


Os  jj<  ...  5  ji+1sn  h  =  l 


tj!Ri-k*2«k>l-  i  M 10 


£  =  w  +  1 


ma*  [  l 

0<  jxs  ...  sj(isn  k  =  l  K  1 

Since  for  w+lsisi,  E  V  p  >  min  (E  V.)  =  E  V  ,  by  the  induction  hypothesis 

n  Z  0  <  k  <  £  n  k 

Z^(n) -*-Z^  a.s.,  where  P(Z^<«)  =1.  Consequently,  the  behavior  of  Z^+^(n) 
depends  upon  the  term 


Wn)  = 


Osj,*  ...SJi„*n  k-1 


i  i  ,Ri-k+2^k^ 


(3.14) 


Os  j  s  ...  s  j  sn  1  =  1 

1  K 


I  £  R.,-k+l^k^ 
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Note  that  if  w *  0  (3.15)  reduces  to 


Yi+l(n)  = 


0  s  s  . . .  s  j  j  s  n  k  *  1 


K.  ^  ,Ri-k+2(Vl 


(3.15) 


which  has  the  desired  properties,  as  can  be  easily  established  by  appealing  to 
Lemma  3.2  (after  rewriting  (3.15)  as  in  the  lemma).  Thus,  assume  w£l. 

Clearly  for  all  M<n 

i-  w  +1 


'  OS 

max 

s  ...  s  j. 

(  l 

-wHSMk  = 

j  Ri-k+2 

w 

+ 

max 

<  I  V 

k+l^k5 

MS  jj 

s  n  k  =  1 

w 

- 

max 

Il,v 

k+l(V5 

°^1 

s  •  •  *  *  K 

s  n  k  =  1 

(3.16) 


0  S  jj  S  ...  S  j i-vj+i  5  n  k  *  1 


i-  w  +1 

(  ^  Ri-k*2^k^* 


By  Lemma  3.4,  to  be  established  later,  we  have  for  all  u>  e  0  and  M>0,  there  is 

an  N,.  >  M  where  for  all  n  >  N,„ 

M  M 


OSj  <...sj  in  k  =  l 


^  ,Rv-k*l^k^  "  ^  . 


MsjjS...sj^sn  k  =  1 


lJ.RwWSk»-  <3-17’ 


Thus,  from  (3.16)  and  (3.17),  we  get 


i  -  w  ♦  1 

1  .  Ri-k*2(ik)' 


s  max  (  I 

OS  jj  S  ...  5  3i_w+iSn  ksl 


i  -  w  +  1 

1  Ri-k+2^k^ 


(3.18) 


From  Lemma  3.2,  it  is  clear  that  the  behavior  of 


i  -  w  ♦  l 


**1* 


max  (  l 

'  5  -*i-w«l  S  n  R  =  1 


Ri-k+2C^k^ 


depends  on  E  V  -  E  V. . 

r  Tt  w  ir  i+l 


CASE  I. 
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where  P(Y < ®)  =1,  independent  of  the  initial  distribution.  Thus,  for  almost 
all  we  n,  and  e  >  0,  we  can  choose  an  M  where 
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Consequently,  it  follows  from  (3.19)  that  Y^+^(n) -+Y  a.s. 


CASE  II.  E  V  -  E  V.  .  SO:  In  this  case,  for  almost  every  wen  and  any  R>0 
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Thus,  from  (3.18)  we  get  that  Yi+1(n) -+®  a.s.. 

Now  the  Lemma  cited  in  Theorem  3.3  is  established. 


LEMMA  3.4.  For  »>  as  defined  in  (3.13),  for  almost  all  utli,  and  for  every  M 
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PROOF:  First,  we  show  that  for  every  M>0  there  exists  an  > M  where 
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Since  E^VW s  min  E^V.  (the  inductive  hypothesis  in  Theorem  3.3  is  still  con- 
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sidered  to  hold),  we  have  that  Z)t(n)  -*■“  a.s..  However,  if  (3.20)  is  not  true, 
then  there  exists  an  M  where 
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Thus,  we  get  that  (3.20)  must  hold.  We  now  show  that  if  M>0,  then  there  is  an 
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First,  for  Ct  as  defined  in  (3.8),  let  C|»0,  Osisw.  Then  by  induction, 
it  is  enough  to  show  that  if  (3.22)  is  true  for  n,  then  it  must  be  true  for  n* 1 
Assume  (3.22)  holds  for  n,  and  that  for  Ms  a.  s  ... 
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Show  for  indices  where  Osb,  £  ...  5b  sn  +  1  and  b,  <M,  there  exist  indices  c 
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where  £  ^w.k+1  (bj)  £  l  ^Rw_k+1  (c±) ,  Msc^  ...scwsn  +  l.  Clearly  if  bw  s  n, 

then  c  =  a  will  suffice.  Thus,  assume  b  *n+l. 
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Let  j  *  min  {k:  b.  a  a. } .  Note  j  >  1,  j  s  w,  and  b.  s  n.  Let 
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Since  Cj  »  z M  and  d^  »  a^  s  n,  get  from  (3.23)  that 
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Thus,  we  have  shown  by  induction  (3.20)  is  true  when  C|»C|«  ...  *0. 

The  case  where  . . .  z  C *  z  0  does  not  follow  automatically,  due  to  the 

peculiar  definition  of  §A(m)  in  (3.4)  necessary  to  deal  with  initial  distribu¬ 
tions.  However,  as  can  be  easily  verified,  if  indices  a  are  selected  which 
satisfy  (3.23)  then  for  any  indices  Osb.  s  ...sb  sn  where  b.  <M,  by  defining 


c  as  above,  we  have  that  l  pw_i+1(bi)  5  l  Rw-i+i^i>v  and  ci‘2M‘  T*1115*  the 
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lemma  is  established.  □ 

It  should  be  pointed  out  that  in  the  above  development.  Lemma  3.2  was  used  on 
the  sums  S^(n),  osisk.  As  stated,  this  lemma  is  not  applicable.  However, 
since  the  proof  of  Lemma  3.2  only  requires  n"1  §^(n)  -►E^V^  a.s.  (see  Chung  [2]), 
the  proof  of  the  theorem  is  still  valid.  We  now  proceed  to  the  proof  of  theorem 


PROOF  OF  THEOREM  3.1.  Using  the  concept  of  an  auxiliary  process,  with  defini¬ 
tions  (3.6),  (3.7),  (3.8)  and  (3.9),  we  note  that  for  every  e>0,  there  exist 
Mq  and  Mj  such  that 
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Thus  we  get 
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Similarly  we  can  establish  that 
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Thus  we  get  that 
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Since  the  convergence  of  Zj(n)  is  independent  of  any  initial  distribution  from 
theorem  3.2,  from  (3.28)  we  can  see  that 


P(Zj (n)  s Xj ,  . . . ,  Zk(n)  s x^)  P(Zj  s Xj ,  ...,  Zk  s xk) . 

4.  CONCLUSION 

The  limit  behavior  of  the  compartments  was  shown  to  depend  on  the  first 
moments  of  the  input  /  output  random  variables.  Since  certain  compartments 
diverge,  it  is  reasonable  to  desire  asymptotic  behavior  of  the  critical  and 


□ 


supercritical  compartments,  appropriately  normalized.  The  behavior  of  these 
compartments  are  investigated  in  (Tollar  [12]) . 

An  area  of  further  research  would  be  on  the  characteristic  function  of  the 
limiting  distribution  of  the  compartments.  Any  such  characterization  seems 
quite  difficult,  however.  For  the  single  cell  model,  results  were  obtained  by 
Puri  [8],  but  the  techniques  used  do  not  seem  applicable  to  the  present  model. 

Another  area  would  be  to  alter  the  model  to  allow  a  more  general  flow 
structure  than  one-way  flow.  However,  unlike  the  present  model,  there  appears 
to  be  no  closed  form  expression  for  Z^(n)  in  the  more  general  framework.  There¬ 
fore  the  use  of  dual  Markov  chains  will  not  be  applicable  to  the  more  general 
model.  It  appears  that  a  more  general  technique  using  Markov  chain  theory  on 
arbitrary  state  spaces  may  be  more  fruitful. 
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